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METHOD TO EVALUATE WHETHER A TIME DELAY IS BETTER THAN A LIMIT 

5 

The invention concerns a method to evaluate whether a time 
delay as an implementation dependent parameter is better 
than a statistically defined soft time limit. The 
invention is especially applied to a class of measurements 

10 measuring the delay time from a cell quality swap, 
generated by a system simulator, to the registration 
message, generated by the user equipment, a mobile station 
for example. In a mobile communication system the mobile 
station (user equipment) should make a cell reselection 

15 or handover to another base station of another 
communication cell if the quality of communication with 
the current base station of the current cell (cell 
quality) decreases and the communication quality with an 
other base station of an other cell increases over the 

20 quality of the current base station. 

Such a soft handover handled by a mobile station in a 
communication system with several base stations for a 
mobile system of the third generation using Code Division 
25 Multiple Access (CDMA) is known from US 5,2 67,2 61 for 
example . 

The communication standard defines a maximum delay time 
from the swap cell quality until the time where the user 

30 equipment issues a registration message in order to 
register to the other base station. However, this time 
delay TD is not defined as a hard limit, i. e. the user 
equipment would not fail the test if the delay time 
exceeds the time limit only a single time, but is defined 

35 as a soft time limit, i. e. the user equipment shall 
fulfil the test requirement for a certain percentage (for 
example 90%) of the cases in repeated measurements. The 
pass fail decision of the test -equipment shall be done 
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with a certain quality, for example 3% wrong decision 
risk. 

From the present state of the art it is not known how to 
5 deal with such statistically defined soft time limits for 
repeated tests. 

Such a test is time consuming. This is illustrated by the 
following example: The success ratio SR in this example is 
10 90%. The time limit in this example is 8s. Due to 
statistical significance it is not enough to observe 9 
successes in 10 measurements. For statistical significance 
it is usual to observe 200*9 successes in 200*10 
measurements. This test lasts 4.5 hours. 

15 

It is the object of the present invention to provide an 
effective method to make a pass fail decision , especially 
on repeated time delay measurements, against a 
statistically defined soft time limit. 

It is further the object of the present invention to 
provide an effective method to make the pass fail decision 
in the- minimum possible test time preserving the 
statistical significance . 

The object is solved alternatively by the features of 
claim 1, 2 , 7 or 8 . 

The depended claims concern further developments of the 
invention. Claims 20 to 23 cover the respective digital 
storage mediums computer program and computer program 
product . 

The invention is further described with respect to the 
35 drawings. In the drawings 



20 



25 



30 



Fig. 1 shows the scenario of cell swap and measurement 
of delay time; 
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Fig. 2 shows a block diagram of the measurement set up; 



Fig. 3 shows a diagram to illustrate the inventive 
method, 

Fig. 4 shows the referenced Error Ratio er norm as a 
function of the measured errors ne, 

Fig. 5- shows a diagram to illustrate a measurement 
using a first embodiment of the inventive 
method, 



Fig. 6 shows a diagram to illustrate a measurement 
using a second embodiment of the inventive 
15 method and 



Fig. 7 shows a diagram illustrating the position at the 
end of the test using the first embodiment of 
the inventive method as a function of 
20 probability. 



Fig. 1 shows the scenario of the swap and measurement of 
time delay. Fig. 2 shows the respective measurement set 
up. 

25 

A system simulator SS simulates the two cells cell 1 and 
cell 2 of a cellular mobile communication system. A User 
Equipment UE (mobile station) is registered to one of the 
cells of the cellular mobile communication system. The 

30 system simulator SS swaps the cell quality at specific 
cyclic time points Tl and T2 . From time Tl until time T2 
cell 1 has the better cell quality compared to cell 2. For 
example the field strength received by the User Equipment 
UE from cell 1 is 3dB higher than received from cell 2. 

35 From T2 to Tl the cell quality of cell 2 is better as the 
cell quality of cell 1. The User Equipment UE should 
recognise the cell swap CS and should react to the cell 
swap CS by issuing a registration message RM. With the 
registration message RM the User Equipment UE registers to 
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the cell serving with better cell quality. The User 
Equipment UE needs a specific time delay TD to evaluate 
and recognise the cell swap CS and to react thereon with 
the registration message RM. This time delay TD is 
5 measured for a specific number of tests by the system 
simulator SS and the result is transferred to the 
controller CO, as shown in Fig. 2. According to the 
inventive method the time delays TD are measured. Each 
time delay TD is hard decided, if it is worse or better 
10 than the time limit. Then it is evaluated whether the 
delays are better than the time-limit in 90% of the 
cases. After sufficient repetitions an overall pass fail 
decision with a wrong decision risk of e.g. 3% is done in a 
minimum possible test time. 

15 

The following realisation is exploited: 

The occurrence of the bad delay in all delays, measured, 
is statistically independent, or can easily made 
statistically independent, by inserting sufficient 
20 recovery time after a registration event. Statistically 
independent events are determined by the binomial 
distribution for any error ratio. (Error Ratio ER = 1-SR 
Success Ratio) 



25 For . small error ratios the binomial distribution is 
approximated by the Poisson distribution. The use of both 
distributions give meaningful results: The Poisson 
distribution give optimal results in terms of test time 
and statistical significance for small error ratios, and 

30 the Poisson distribution is well supported in mathematical 
software tools. 



For high error ratios the Poisson distribution give sub- 
optimal results. The results are conservative in the 
35 sense: Test time is longer (worse) than optimal. Wrong 
decision risk is lower (better) than predefined. 

The binomial distribution is optimal in terms of test time 
and statistical significance for any error ratio. However 
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the binomial distribution is not so well supported in 
standard mathematical software tools. Both derivations are 
described in the following. 

5 According to the present invention, the worst possible 
likelihood distribution PD high and/or the best possible 
likelihood distribution PD low are obtained by the formulas 
given in claim 1 or 2 and 7 or 8 , respectively. From these 
likelihood distributions, the average number NE high or 
NE low is obtained and compared with NE limit/ respectively. 
If NE limlt is higher than the average number NE high or 
smaller than the average number NE low , the test is stopped 
and it is decided that the device has early passed or 
early failed, respectively. During the test a single step 
wrong decision probability for a preliminary ER stage can 
be used, which is smaller than the probability for the 
entire test. 



The Poisson distribution preferably used for the present 
20 invention, is best adapted to a small number of "bad delay 
times". A "bad delay time" is defined as a delay time, 
exceeding the time limit. For example a measured time 
delay exceeding the time limit of 8s would be a "bad time 
delay", also referred to as an "error". A measured time 
25 delay TD below the time limit, of for example 8s, would be 
a "good time delay" . 

In the following, a test procedure together with the early 
fail condition and the early pass condition is derived 
30 with mathematical methods. 

The ER test procedure is an iterative process: The number 
ns of delays TD and the number of errors ne are 
accumulated from the beginning of the test to calculate a 
preliminary ER (Error Ratio) . Time delays TD up to the 
next error are used together with the past time delays TD 
to calculate the next preliminary ER. Every preliminary ER 
is tested against an early pass or early fail bound. The 
formulas to derive an early pass or early fail condition 
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contain a single step wrong decision probability D. This 
is valid only for one specific preliminary ER stage. 
However, it is meaningful to have a wrong decision 
probability F for the entire test (F>D) . The application 
5 proposes to use a single step wrong decision probability 
D, which is smaller than the probability for the entire 
test and proposes a method to derive D from a given F. 

Due to the nature of the test, namely discrete error 
events, the early stop conditions are declared not valid, 
when a fractional number of bad time delays < 1 are used 
to calculate the early stop limits. The application 
contains proposals, how to conduct the test at this 
undefined areas. The proposals are conservative (not 
15 risky) . A DUT on the ER-limit does not achieve any early 
stop condition. The application proposes to stop the test 
unconditioned at a specific number K (for example 200) bad 
time delays. As this proposal contains different 
measurement qualities, an additional proposal is made to 
20 overcome this drawback. 
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Based on a measurement at a preliminary ER stage pERs, 
confidence range CR around this measurement is derived. It 
has the property that with high probability the real 
result can be found in this range. 

The confidence range CR is compared with the specified ER 
limit. From the result a diagram is derived containing the 
early fail and the early pass condition. 

With a finite number of delays ns , the final Error Ratio 
ER cannot be determined exactly. Applying a finite number 
of delays ns, a number of bad time delays ne is measured, 
ne/ns = er is the preliminary Error Ratio. 

In a test at a preliminary ER stage pERs a finite number 
ns of measured time delays TD is applied, and a number of 
bad time delays ne is measured, ne is connected with a 
certain differential probability in the Poisson 
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distribution. The probability and the position in the 
distribution conducting just one test at a preliminary ER 
stage pERs is not known. 



5 Repeating this test infinite times, applying repeatedly 
the same ns, the complete Poisson distribution is 
obtained. The average number (mean value) of bad time 
delays is NE. NE/ns is the real ER at the DUT. The Poisson 
distribution has the variable ne and is characterised by 

10 the parameter NE, the average or mean value. Real 
probabilities to find ne between two limits are calculated 
by integrating between such limits. The width of the 
Poisson distribution increases proportional to SQR (NE) , 
that means, it increases absolutely, but decreases 

15 relatively. 



In a test at a preliminary ER stage pERs ns time delays TD 
are applied and ne bad time delays are measured. The 
result can be a member of different Poisson distributions 
20 each characterized by another parameter NE . Two of them 
are given as follows: 

The worst possible distribution NE high , containing the 
measured ne with . the probability D lr is given by the 
25 inverse cumulative operation 

ne 

D i = \PDM g nfaNE high )d>n 

(1) 

In the example D x is 0.002=0.2% PD high is the wanted 
30 Poisson distribution with the variable ni . ne is the 
measured number of bad time delays. 

The best possible distributions NEi ow , containing the 
measured ne with the probability D 2 is given by the 
35 inverse cumulative operation 
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8 



oo 

D 2 =\PD low (ni,NE low )dni 

(2) 

In the example D 2 is equal D x and itisD = D 1 = D 2 = 
0.002=0.2%. 

5 

To illustrate the meaning of the range between NE]_ ow and 
NE high refer to Fig. 3. Fig. 3 shows the likelihood 
density PD as a function of the measured number of bad 
time delays ne . In the example, the actual detected number 

10 of bad time delays ne within the measured number ns of 
time delays TD is 10. The likelihood distribution of the 
bad time delays is not known. The worst possible 
likelihood distribution PD high under all possible 
likelihood distributions as well as the best possible 

15 likelihood distribution PD low under all possible 
likelihood distributions are shown. The worst possible 
likelihood distribution PD high is characterized in that 
the integral from 0 to ne = 10 gives a total probability 
of D ± = 0.002. The best possible likelihood distribution 

20 PD low is characterized in that the integral from ne = 10 
to co gives a total probability of D 2 = 0.002. In the 
preferred embodiment D x is equal to D 2/ i.e. D x = D 2 = 
0.002 = 0.2%. After having obtained the likelihood 
distribution PD high and PD low from formulas (1) and (2) , 

25 the average values or mean values NE high for the 
likelihood distribution PD high and NE low for the likelihood 
distribution PD low can be obtained. The range between the 
mean values NE iow and NE high is the confidence range CR 
indicated in Fig. 3. 

30 

In the case the measured value ne is a rather untypical 
result (in the example just 0.2% probability) nevertheless 
the real result NE can still be found in this range, 
called confidence range CR. 

35 

The probabilities D x and D 2 in (1) and (2) can be 
independent, but preferable they are dependent and equal 
(D = Di = D 2 ) . 



WO 2004/036945 j 



9 



T/EP2003/010873 



For the Poisson distribution NEi ow and NE high are the 
result of the inverse cumulative operations above and are 
shown in formulas (3) and (4) respectively. The inputs are 
5 the number of bad time delays ne, measured in this test, 
and the probabilities D and C = 1- D. The Output is NE, 
the parameter describing the average of the Poisson 
distribution. 

10 The following example is illustrated in Fig. 3 (D = D x = 
D 2 ) : 

Ar27 qchisq(D,2-ne) 

l\±L low = (3) 

Example : 

Number of bad time delays: ne=10 
20 Probability: D=0.002 C=0.998 

Result : 

NE low =3.26 
25 NE high = 22.98 

Interpretation : 

Having measured ne=10 bad time delays in a test with 
preliminary ER stage pERs, then at a low probability 
D=0.002 the average number of bad time delays NE in this 
test is outside the range from 3.26 to 22.98 or with a 
high probability C=0.998 inside this range from 3.26 to 
22 . 98 . 

35 Such as the width of the Poisson distribution, the 
confidence range CR increases proportional to SQR(ne), 
that means, it increases absolutely, but decreases 
relatively. 
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If the entire confidence range CR, calculated from a 
single result ne, is found on the good side (NE limit > 
NEhigh) of the specified NEii m it we can state: With high 
5 probability C, the final result NE is better than NE limit . 
Whereby NE limit is given by 

NE limifc = ER limit • ns (5) 



and ER limit is the Error Ratio allowable for the device and 
obtained by an ideal long test with an infinite high 
number ns of time delays TD. 

If the entire confidence range CR, calculated from a 
single result ne, is found on the bad side (NE!i mit < 
NE low ) of the specified NEi imit we can state: With high 
probability C, the final result NE is worse than the ER- 
limit . 

With each new time delay TD a new test is considered, 
reusing all former results. With each new test the 
preliminary data for ns, ne and er is updated. For each 
new test the confidence range CR is calculated and checked 
against NE limit . 



Once the entire confidence range CR is found on the good 
side of the specified limit (NE limit > NE high ) , an early 
pass is allowed. Once the entire confidence range CR is 
found on the bad side of the specified limit (NE limit < 
30 NE low ) an early fail is allowed. If the confidence range 
CR is found on both sides of the specified limit (NE low < 
NE limit < NE high ) , it is evident neither to pass nor to 
fail the DUT early. 



Fig. 3 illustrates the above conditions. Of course, NEii m i t 
is a fixed value not altering during the test, but NE low 
and NE h i gh as well as the confidence range CR are altering 
during the test. For reasons of illustration, however, the 
three possibilities of the possible positions of the 
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confidence range CR with respect to the constant NE!i mit 
are drawn for the same example in Fig. 3. 



5 



The above can be described by the following formulas: 

The current number ns of time delays TD is calculated from 
the preliminary Error Ratio er and the preliminary number 
of bad time delays ne 

10 er = ne/ns (6) 

The specified ER expressed with number of time delays ns 
and number of bad time delays NE is 

15 ER limit = NE limit / ns (7) 

for abbreviation in the formula: 

er norm = e r/ER limit = ne/ NE limifc 
20 (normalised er) (8) 

Early pass stipulates: 

NE high < NElimit (9) 

25 

Early fail stipulates: 

NE low > NE limit (1Q) 

30 Formula for the early pass limit: 

ne 

er norm ~x rin (ID 

lyjithigh 



35 This is the lower curve (ernorir^ ass (ne, C) ) in Fig. 4, 
which shows er norm as a function of ne. 



Formula for the early fail limit: 
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ne 

norm \TT7* (12) 

This is the upper curve (ernorm fail (ne, D) ) in Fig. 4. 

5 

As the early pass limit is not defined for ne = 0 
(normally the case at the very beginning of the test for a 
good DUT) , an artificial bad time delay event with the 
first measured time delay TD can be introduced. When the 
10 first real bad time delay event occurs, the artificial bad 
time delay is replaced by this real one. This gives the 
shortest possible measurement time for an ideal good DUT. 
For example ns=50 for ER limit =0.1 and probability D = D x = 
D 2 = 0.2%. (6 minutes 20s) 

15 

As the early fail limit uses NE low < 1 for small ne<k (in 
the example below k=5) due to a decision problem at a 
fractional error, the early fail limit at ne=k is extended 
with a vertical line upwards. This ensures that a very bad 
20 DUT hits the early fail limit in any case after a few 
delays, approx. 10 in the example (1 minute 20s) . In other 
words, the test is not stopped as long as ne is smaller 
than k. 

25 With each new time delay TD a new test is considered, 
reusing all former results. With each new test the 
preliminary data for ns, ne and er and er norm are updated 
and a er norm /ne coordinate is entered into the er norm - 
diagram. This is shown in Fig. 5. Once the trajectory 

30 crosses the early fail limit (er norm (ne,D)) or the early 
pass limit (er norm (ne,C)) the test may be stopped and the 
conclusion of early fail or early pass may be drawn based 
on this instant. 

35 Fig. 5 shows the curves for early fail and early pass. 
er norm is shown as a function of the number of bad time 
delays ne . For the simple example demonstrated in Fig. 5, 
it is ER limit = 0.2 = 1/5 and the final Error Ratio ER = 
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0.25 (1/4). The test starts with the first time delay TD, 
for which no error (bad time delay) is detected. For the 
second time delay TD, a first error (bad time delay) is 
detected and the preliminary Error Ratio er = ne/ns =1/2 
5 and er norm = er/ER limit becomes 1/2 : 1/5 = 5/2. er norm 
after the second time delay TD is marked with a cross a in 
Fig. 5. For the third, fourth and fifth time delay TD, no 
further error (bad time delay) occurs and er norm 
subsequently becomes 5/3, 5/4 and 5/5, respectively, which 
10 is marked with the crosses b, c and d in Fig. 5, 
respectively. The sixth time delay TD brings a new error 
(bad time delay) and ne becomes 2. Consequently, er = 
ne/ns becomes 2/6 and er norm becomes 10/6. This situation 
is marked with cross e in Fig. 5. For the seventh, eighth 
15 and ninth delay TD, no further error (bad time delay) 
occurs and the situation after the seventh, eighth and 
ninth delay TD is marked with crosses f, g, h in Fig. 5, 
respectively. The tenth time delay TD brings a third error 
(bad time delay) . Consequently, er becomes 3/10 and er norm 
becomes 15/10. This situation is marked with cross i in 
Fig. 5. As can be seen from Fig. 5, the trajectory is 
between the early fail curve and the early pass curve at 
the beginning of the test, but converges to a line Z, 
which crosses the early fail curve after about forty 
25 errors. After forty errors, it can thus be decided that 
the tested DUT early fails the test. 

The calculations above give optimal results in terms of 
test-time for small error ratios /high success ratios. If 
this is not the case, the approach with the Poisson 
distribution can be used nevertheless. For any error 
ratio/success ratio the binomial distribution is valid. 
The Poisson distribution is wider than the equivalent 
binomial distribution, hence the confidence range is 
wider, hence the space between the early pass and the 
early fail limit is wider, hence the result is not optimal 
in terms of test-time, but conservative is the following 
sense: the test-time is longer than optimal and the wrong 
decision risk is lower than predefined. 
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To get optimal results also for higher error ratios/lower 
success ratios the binomial distribution must be applied 
as follows: 

5 The binomial distribution has the following form: 
dbinom (ne , ns , ER) 
with 

ne: number of errors (bad time delays) detected, 
ns, number of time delays TD, measured, 
0 (ne/ns = preliminary error ratio er) 

ER: the mean value of the distribution is the error ratio 

The worst possible distribution with respect to a measured 
er=ne/ns is defined by the inverse cumulative operation: 



with 

D: wrong decision risk 
20 ni : integration variable 

ne: number* of errors (bad time delays) currently detected, 
simultaneously integration limit 

ns : number of time delays TD, currently measured 
ERhigh- The parameter to be tuned, to make the integral 
25 consistent. This is the wanted value. 

The result has the form: ER high = qbinom (C,ne,ns) 

With C=l-D, the complementary wrong decision risk is equal 

to the confidence level . 

30 The best possible distribution is defined by the inverse 
cumulative operation: 



ne 



D = 




0 



(13) 



ns 



D = 




ne 



(14) 
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ne: number of errors (bad time delays) currently detected, 
simultaneously integration limit 

ns: number of time delays TD, currently measured, 
simultaneously integration limit 
5 ER low : The parameter to be tuned, to make the integral 
consistent. This is the wanted value. 
The result has the form: ER low = qbinom (D,ne,ns) 

Another inverse cumulative inversion, than the one above, 
10 is frequently offered with standard mathematical software 
tools. The form is similar: qbinom (D, at least one other 
parameters than above) . 

The confidence range is the range between ER high and ER low . 
15 The normalized er norm is the measured (preliminary) 
er=ne/ns divided by ER limit 

Early pass stipulates : 
ERhigh < ER limit 

20 

Early fail stipulates: 
ER low > ER limit 

In analogy to the Poisson approach, the early fail limit 
25 is 

er norm fail = er/ER low (15) 
The early pass limit is 

30 

er norm pass = er/ER high (15) 

The following consideration is valid for both, the Poisson 
and the binomial approach: 
35 If no early stop occurs the ER test may be stopped, after 
the following condition is valid: 



ne >= K 



(17) 
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and the DUT shall be passed, if ns is sufficiently high. K 
is a maximum number of errors (bad time delays) . For 
example K can be 200. 



5 If the trajectory neither crosses the early fail curve nor 
the early pass curve after K (for example 2 00) errors (bad 
time delays) have occurred, the DUT can be finally passed. 
If the DUT, however, is rather good or rather bad, the 
tests can be stopped much earlier, long before the K = 200 

0 errors (bad time delays) have occurred. This significantly 
shortens the total test time. 



In the above embodiment early fail means: a DUT, which 
survived to certain preliminary ER stage, is failed and a 

15 probability of 0.2 % that it is actually better than the 
ER-limit is accepted. Further early pass means: the DUT, 
which survived to certain preliminary ER stage, is passed 
and a probability of 0.2 % that it is actually worse than 
the ER-limit is accepted. If the test is stopped at 200 

20 errors (bad time delays) the DUT is passed without any 
early fail or early pass condition arbitrarily. It can 
cross the vertical 200 error line in Fig. 4 at different 
heights . 

25 Each height is connected with a certain statistical 
interpretation: The probability to have a DUT better 
(worse) than the ER-limit is indicated in Fig. 7. The 
vertical in Fig. 7 shows the position in Fig. 4 at the end 
of the test. The horizontal line in Fig. 7 shows the 

30 respective probability. Hence such a test has different 
qualities, a better one at the early pass fail limits, and 
a worse and variable one at the unconditioned stop at 200 
errors 

35 The following embodiment overcomes this drawback and 
additionally accelerates the test. This is done by a 
meaningful redefinition of the early pass limit 
maintaining the early fail limit. Early pass means now: A 
DUT, which survived to certain preliminary ER stage, is 
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passed and a probability of 0.2 % that it is actually 
worse than M times the specified ER- limit (M > l) is 
accepted. This is a bad DUT ER-limit. This shifts the 
early pass limit upwards in Fig. 4 as shown in Fig. 6. 
5 er norm pass (ne, C) in Fig. 4 becomes er normbad pass ( n e, C) 
m Fig. 6. er norm fail (ne, D) remains unchanged. Now it is 

NE limit,M = ER limit " M • ns for Poisson 
ER limit,M = ER limit " M for Binomial 

and an early pass is allowed, if 

NE limit ' M = NE lirnitfM > NE high . (Poisson) 
ER limit " M = ER limit,M > ER high (binomial) (18) 



There are three high level input parameters for the test: 

- Specified error limit e.g. 10% 

- Probability to make a wrong decision in the entire test 
(proposal: F= 3 %) 

- Definition of a bad DUT (ER limit • M) 

From this the working parameters are derived: 
D, the wrong decision risk for a single test step, is 
derived from F, the wrong decision risk for the entire 
test. The method to do this is described below. 

With D the early pass and fail limits can be calculated 
according to formula 11, 12, 15, 16. 

The intersection co-ordinates of the early pass and the 
early fail limit are the maximum number of errors (bad 
time delay) and the error ratio test limit TL (specified 
error limit<TL<M*specif ied error limit) . 

There are infinite possibilities to overcome the above 
mentioned drawback with different test qualities. 

In the example above the open end between the pass fail- 
limits was originally declared pass, and time was saved by 
multiplying the early pas's limit with M (M>1) , shifting it 
upwards such that the early fail and the early pass curve 
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intersect at 200 errors (200 bad time delays: example from 
above) . Thus only a DUT, bad with high probability, is 
failed (customer risk) . 

5 The complementary method is: The open end between the 
early pass fail limits is declared fail, and time is saved 
by multiplying the early fail limit with m (0<m<l) , 
shifting it downwards, such that the early fail and the 
early pass curve intersect at 2 00 errors (200 bad time 
delays: example from above) . Thus only a DUT, good with 
high probability, is passed (manufacturer risk) . 

i 

The compromise method is: The open end between the early 
pass fail limits is partitioned in any ratio: the upper 
part is declared fail and the lower part is declared pass. 
Time is saved by multiplying the early fail limit with m 
(0<m<l) and such shifting it downwards and by multiplying 
the early pass limit with M (M>1) and such shifting it 
upwards. So the early fail and the early pass curve 
intersect at 200 errors (200 bad time delays: example from 
above) . 
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30 



With given D x and D 2 the early fail curve and the early 
pass curves in Fig. 5 and Fig. 4 or Fig. 6 can be 
calculated before the test is started. During the test 
only er norm = ne/NEi imit (for binomial: er norm = er/ER limit ) 
has to be calculated and to be compared with the early 
pass limit and the early fail limit as explained with 
respect to Fig. 5 and Fig. 6. Thus, no intensive 
calculation has to be done during the test. 



D x and D 2 above describe the single step wrong decision 
probability for a DUT, which survived without early stop 
to a certain preliminary ER stage. For a real test it is 
35 desirable to define in advance a wrong decision 
probability F for the entire test. For every step a 
fraction of DUTs leave the statistical totality due to 
single step wrong decision probability D. This accumulates 
to an amount F>D. 
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It is proposed to derive D from F by the following method: 

Based on statistical independence, a large ensemble of 
5 DUTs with ER on the ER-limit (limit-DUT) and with M*ER 
(bad DUT) is simulated and the entire test for the limit- 
DUT ensemble and the bad DUT ensemble is run by simulation 
against the early pass and early fail bound, with a free 
D-parameter (D x and D 2 ) . The simulation will show, that a 
10 certain fraction F (D<F<1) of the large ensemble falsely 
fails (limit-DUT) or falsely passes (bad DUT) . This 
represents the wrong decision probability F for the entire 
test. D is tuned such that F corresponds to the predefined 
wrong decision probability. 
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The initially mentioned wrong decision risk 3% 
corresponds, as a result of the simulation, the single 
step wrong decision risk of 0.2% applied in the formulas 
and figures. 



In retrospect the distributions are not any more exact 
applying this simulation: Once a DUT leaves the 
statistical totality due to early fail or early pass, the 
subsequent distribution is changed. In so far the 
25 initially selected distribution has its intended validity 
only at the beginning of the test. Due to early passes and 
early fails the distribution is truncated more and more 
towards the end of the test. These truncated distributions 
cannot be handled anymore analytically, and so it is 
impossible to derive D from F analytically. It is possible 
to derive each subsequent distribution by numerical 
methods. Then it is possible to derive D from F 
numerically. In the above proposed process, just a unique, 
the initial distribution is applied as approximation 
35 instead of a set of correct distributions. With a set of 
correct distributions it is possible to calculate D from F 
by: 



i 7 = l-(l-D) 



(19) 
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Generally it can be assumed: 



F>DZ1-(1-F) U ~ (20) 

5 

This formula can serve as an infimum for D, if the method 
is based on simulation using the initial distribution. 
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Claims 
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1 . Method for testing the time delay error ratio ER of a 
device against a maximal allowable time delay error ratio 
ER limit with an early pass criterion, whereby the early 
pass criterion is allowed to be wrong only by a small 
probability D lt with the following steps 

- measuring ns time delays (TD) of the device, thereby 
detecting ne bad time delays, which exceed a certain time 
limit, of these ns time delays (TD) , 

- assuming that the likelihood distribution giving the 
distribution of the number ni of bad time delays in a 
fixed number of samples of time delays (TD) is PD (ni , NE) 
wherein NE is the average number of bad time delays, 
obtaining PD h i gh from 

ne 

Di = \PD high (ni,NE Mgh )dni 

0 

wherein PD high is the worst possible likelihood 
distribution containing the measured ne bad time delays 
with the probability D i# 

- obtaining the average number NE high of bad time delays 
for the worst possible likelihood distribution PD high , 

- comparing NE high with NEi imit = ER limit • ns, 

- if NEi imit is higher than NE high stopping the test and 
deciding that the device has early passed the test and 

- if NE limit is smaller than NE high continuing the test 
whereby increasing ns . 

2. Method for testing the time delay error ratio ER of a 
device against a maximal allowable time delay error ratio 
ER limit with an early pass criterion, whereby the early 
pass criterion is allowed to be wrong only by a small 
probability F x for the entire test, with the following 
steps 

- measuring ns time delays (TD) of the device, thereby 
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detecting ne bad time delays, which exceed a certain time 
limit, of these ns time delays (TD) 

- assuming that the likelihood distribution giving the 
distribution of the number ni of bad time delays in a 

5 fixed number of samples of time delays (TD) is PD (ni , NE) 
wherein NE is the average number of bad time delays, 
obtaining PD high from 

ne 

°i = !PD high (m,NE Ugh )dni 

0 

10 wherein PD high is the worst possible likelihood 
distribution containing the measured ne bad time delays 
with a single step wrong decision probability D x for a 
preliminary error ratio ER stage, whereby using a single 
step wrong decision probability D x smaller than the 
probability F x for the entire test, 

- obtaining the average number of NE high of bad time 
delays for the worst possible likelihood distribution 

- comparing NE high with NE liinit = ER limit • ns, 

- if NE limit is higher than NE high stopping the test and 
deciding that the device has early passed the test and 

- if NEii mit is smaller than NE high continuing the test 
whereby increasing ns . 

25 3. Method according to claim 1, 
characterized in that 

the single step wrong decision probability D x is in the 
range of 

4 . Method according to any of claims 1 to 3 , 
characterized in that 

the likelihood distribution PD high (ni , NE) is the Poisson 
35 distribution. 
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5. Method according to any of claims 1 to 3, 
characterized in that 
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the likelihood distribution PD high (ni ,NE) is the binomial 
di s t r ibut i on . 

6. Method according to any of claims 1 to 5, 
5 characterized in that 

for avoiding an undefined situation for ne=0 starting the 
test with an artificial bad time delay ne=l, not 
incrementing ne then a first error occurs. 

10 7. Method for testing the time delay error ratio ER of a 
device against a maximal allowable time delay error ratio 
ER limit with an early fail criterion, whereby the early 
fail criterion is allowed to be wrong only by a small 
probability D 2 , with the following steps 

15 - measuring ns time delays (TD) of the device, thereby 
detecting ne bad time delays, which exceed a certain time 
limit, of these ns time delays (TD) , 

- assuming that the likelihood distribution giving the 
distribution of the number ni of bad time delays in a 

20 fixed number of samples of time delays (TD) is PD (ni , NE) , 
wherein NE is the average number of bad time delays, 
obtaining PD iow from the 

CO 

ne 

25 

wherein PD low is the best possible likelihood distribution 
containing the measured ne bad time delays with the 
probability D 2/ 

- obtaining the average number NE low bad time delays for 
30 the best possible likelihood distribution PD low , 

- comparing NE low with NE limit = ER limit ' ns, 

- if NEnmit is smaller than NE low stopping the test and 
deciding that the device has early failed the test and 

- if NEii mit is higher than NE iow continuing the test 
35 whereby increasing ns. 



8. Method for testing the time delay error ratio ER of a 
device against a maximal allowable time delay error ratio 
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ER limit with an early fail criterion, whereby the early 
fail criterion is allowed to be wrong only by a small 
probability F 2 for the entire test., with the following 
steps 

5 - measuring ns time delays (TD) of the device, thereby 
detecting ne bad time delays, which exceed a certain time 
limit, of these ns time delays (TD) , 

- assuming that the likelihood distribution giving the 
distribution of the number ni of bad time delays in a 
fixed number of samples of time delays (TD) is PD ( ni , NE ) , 
wherein NE is the average number of bad time delays, 
obtaining PDi ow from 



°2 =jPD low (ni,NE, ow )dni 

ne 

15 wherein PD low is the best possible likelihood distribution 
containing the measured ne bad time delays with a single 
step wrong decision probability D 2 for a preliminary error 
ratio ER stage, whereby using a single step wrong decision 
probability D 2 smaller than the probability F 2 for the 

20 entire test, 

- obtaining the average number NEi ow bad time delays for 
the best possible likelihood distribution PD low , 

- comparing NE low with NE limit = ER limit ■ ns, 

- if NEiimit is smaller than NE iow stopping the test and 
25 deciding that the device has early failed the test and 

- if NE limit is higher than NE low continuing the test 
whereby increasing ns . 

9. Method according to claim 8, 
30 characterized in that 

the single step wrong decision probability D 2 is in the 
range of 



F 2 >D 2 >\-(\-F 2 ) Vne . 

35 

10. Method according to any of claims 7 to 9, 
characterized in that 

the likelihood distribution PD low (ni,NE) is the Poisson 
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di s t r ibut ion . 
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11. Method according to any of claims 7 to 9, 
characterized in that 

the likelihood distribution PD low (ni,NE) is the binomial 
distribution. 

12. Method according to any of claims 7 to 11, 
characterized in that 

for avoiding a undefined situation for ne<k, wherein k is 
a small number of bad time delays, not stopping the test 
as long as ne is smaller than k. 

13. Method according to any of claims 7 to 12, 
15 characterized by 

an additional early pass criterion, whereby the early pass 
criterion is allowed to be wrong only by a small 
probability D x , with the following additional steps 
- assuming that the likelihood distribution giving the 
distribution of the number of bad time delays ni in a 
fixed number of samples of time delays (TD) is PD (ni , NE) 
wherein NE is the average number of bad time delays, 
obtaining PD high from 

ne 

25 D i - SPD Ugh (m,NE high )dni 



20 



30 



35 



wherein PD high i s the worst possible likelihood 
distribution containing the measured ne -bad time delays 
with the probability D lt 

- obtaining the average number NE h i gh of bad time delays 
for the worst possible likelihood distribution PD high , 

- comparing NE high with NE limit = ER limit - ns, 

- if NE limit is higher than NE high stopping the test and 
deciding that the device has early passed the test and 

if NE limit is smaller than NE high continuing the test, 
whereby increasing ns. 



14. Method according to any of claims 7 to 12, 
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characterized by 

an additional early pass criterion, whereby the early pass 
criterion is allowed to be wrong only by a small 
probability D lt with the following additional steps 
5 - assuming that the likelihood distribution giving the 
distribution of the number of bad time delays ni in a 
fixed number of samples of time delays (TD) is PD (ni , NE) , 
wherein NE is the average number of bad time delays,' 
obtaining PD high from 

ne 

D i = \PD high (ni,NE hlgh )dni 



wherein PD high is the worst possible likelihood 
distribution containing the measured ne bad time delays 
15 with the probability D l7 

- obtaining the average number NE high of bad time delays 
for the worst possible likelihood distribution PD high , 

- comparing NE high with NE limit , M = ER llmit • M • ns, with 
M > 1, 

if NEi imit;M is higher than NE high stopping the test and 
deciding that the device has early passed the test and 

if NEi imitfM is smaller than NE high continuing the test, 
whereby increasing ns . 
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15. Method according to claim 13 or 14, 
characterized in that 

the probability D x for the wrong early pass criterion and 
the probability D 2 for the wrong early fail criterion are 
equal (D 1= D 2 ) . 

16. Method according to any of claims 7 to 12, 
characterized by 

an additional early pass criterion, whereby the early pass 
criterion is allowed to be wrong only by a small 
probability Fl for the entire test, with the following 
additional steps 

- assuming that the likelihood distribution giving the 
distribution of the number ni of bad time delays in a 
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fixed number of samples of time delays (TD) is PD (ni , NE) , 

wherein NE is the average number of bad time delays, 
obtaining PD high from 

ne 

5 Di = \PD hish {ni,NE hish )dni 



wherein PD high is the worst possible likelihood 
distribution containing the measured ne bad time delays 
with the single step wrong decision probability D ± for a 
preliminary error ratio ER stage, whereby using a single 
step wrong decision probability D x smaller than the 
probability F x for the entire test, 

- obtaining the average number of NE high bad time delays 
for the worst possible likelihood distribution PD high , 

15 - comparing NE high with NE limit = ER limit • ns, 

- if NE limit is higher than NE high stopping the test and 
deciding that the device has early passed the test and 

- if NE limit is smaller than NE high continuing the test, 
whereby increasing ns . 
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20 

17. Method according to any of claims 7 to 12, 
characterized by 

an additional early pass criterion, whereby the early pass 
criterion is allowed to be wrong only by a small 
25 probability F x for the entire test, with the following 
additional steps 

- assuming that the likelihood distribution giving the 
distribution of the number ni of bad time delays in a 
fixed number of samples of time delays (TD) is PD (ni , NE) 
30 wherein NE is the average number of bad time limits, 
obtaining PD high from 

ne 

°i - \PD Ugh (ni,NE high )dni 



35 wherein PD high is the worst possible likelihood 
distribution containing the measured ne bad time delays 
with the single step wrong decision probability D x for a 
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preliminary error ratio ER stage, whereby using a single 
step wrong decision probability d x smaller than the 
probability F x for the entire test, 

- obtaining the average number NE high of bad time delays 
> for the worst possible likelihood distribution PD high , 

- comparing NE high with NE limit/M = ER limlt • M • ns, with 
M > 1 

- if NE limit#M is higher than NE high stopping the test and 
deciding that the device has early passed the test and 

- if NE limit(M is smaller than NE high continuing the test, 
whereby increasing ns . 

18. Method according to claim 16 or 17, 
characterized in that 

the probability P x for the wrong early pass criterion and 
the probability F 2 for the wrong early fail criterion are 
equal (F!=F 2 ) . 

19. Method according to any of claims 7 to 18, 
20 characterized in that 

for avoiding a undefined situation for ne=0 starting the 
test with an artificial bad time delay ne=l not 
incrementing ne then a first error occurs. 

25 20. Digital storage medium with control signals 
electronically readable from the digital storage medium, 
which interact with a programmable computer or digital 
signal processor in a manner that all steps of the method 
according to any of claims 1 to 19 can be performed. 

30 

21. Computer -program-product with program- code -means 
stored on a machinereadable data carrier to perform all 
steps of any of claims 1 to 19, when the program is 
performed on a programmable computer or a digital signal 
35 processor. 



22. Computer program with 
all steps of any of claims 
performed on a programmable 



program- code -means to perform 
1 to 19, when the program is 
computer or a digital signal 
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processor . 



23. Computer program with 
all steps of any of claims 
5 stored on a machinereadable 



program- code -means to perform 
1 to 19 when the program is 
data carrier. 
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